# DPO alignment optimization

TinyLlama is a lightweight 1.1B-parameter Llama model pre-trained on 3 trillion tokens, fine-tuned for conversation and alignment optimized, suitable for resource-constrained scenarios.

TinyLlama is a 1.1 billion parameter Llama model pre-trained on 3 trillion tokens, suitable for scenarios with limited computation and memory resources.